Skip to content

Implement disallow for Draft 3#781

Merged
jviotti merged 2 commits intomainfrom
draft3-disallow
May 5, 2026
Merged

Implement disallow for Draft 3#781
jviotti merged 2 commits intomainfrom
draft3-disallow

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented May 5, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@augmentcode
Copy link
Copy Markdown

augmentcode Bot commented May 5, 2026

🤖 Augment PR Summary

Summary: Adds full compiler support for Draft 3’s disallow keyword.

Changes:

  • Introduces a helper to map Draft 3 type strings into the internal ValueTypes bitset.
  • Compiles disallow for both string and array forms, including support for embedded subschemas via LogicalNot.
  • Special-cases "any" to always fail validation, matching Draft 3 semantics.
  • Enables the previously-blacklisted Draft 3 official-suite tests for disallow.

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 1 suggestion posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

Comment thread src/compiler/default_compiler_draft3.h Outdated
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: d6a7781 Previous: cb26a0b Ratio
E2E_Compiler_adaptivecard 70079053.87500557 ns/iter 65822376.99999244 ns/iter 1.06
E2E_Compiler_ansible_meta 30011792.173913028 ns/iter 29441992.333332222 ns/iter 1.02
E2E_Compiler_aws_cdk 373879.226063846 ns/iter 389892.62986270344 ns/iter 0.96
E2E_Compiler_babelrc 2587946.2333334773 ns/iter 2693342.905303098 ns/iter 0.96
E2E_Compiler_clang_format 18627869.184208043 ns/iter 18823131.594595492 ns/iter 0.99
E2E_Compiler_cmake_presets 26232181.96296656 ns/iter 26548559.230766736 ns/iter 0.99
E2E_Compiler_code_climate 2628393.700374477 ns/iter 2664955.996183276 ns/iter 0.99
E2E_Compiler_cql2 13045466.113206906 ns/iter 13271585.54716952 ns/iter 0.98
E2E_Compiler_cspell 23146835.666667208 ns/iter 23585312.266667794 ns/iter 0.98
E2E_Compiler_cypress 3962777.813559618 ns/iter 4047864.4011628595 ns/iter 0.98
E2E_Compiler_deno 7785514.899999019 ns/iter 7949088.409090295 ns/iter 0.98
E2E_Compiler_dependabot 4010790.619318527 ns/iter 4051781.236994088 ns/iter 0.99
E2E_Compiler_draft_04 2730293.1959998203 ns/iter 2755971.854330656 ns/iter 0.99
E2E_Compiler_fabric_mod 4824917.924137763 ns/iter 4897149.601398885 ns/iter 0.99
E2E_Compiler_geojson 22580539.193548307 ns/iter 22681029.193548847 ns/iter 1.00
E2E_Compiler_gitpod_configuration 4957295.659574547 ns/iter 5027719.978417846 ns/iter 0.99
E2E_Compiler_helm_chart_lock 685829.5583905734 ns/iter 722656.424557695 ns/iter 0.95
E2E_Compiler_importmap 277112.27024888835 ns/iter 293977.57281147694 ns/iter 0.94
E2E_Compiler_jasmine 1371266.1076319257 ns/iter 1401715.306613283 ns/iter 0.98
E2E_Compiler_jshintrc 4399780.446541307 ns/iter 4471299.833333648 ns/iter 0.98
E2E_Compiler_jsconfig 22394503.433330707 ns/iter 22735939.967740323 ns/iter 0.98
E2E_Compiler_krakend 150783571.59998176 ns/iter 151367130.39998993 ns/iter 1.00
E2E_Compiler_lazygit 34800132.50000411 ns/iter 34620336.89999657 ns/iter 1.01
E2E_Compiler_lerna 1598874.0390804228 ns/iter 1658061.3578201667 ns/iter 0.96
E2E_Compiler_nest_cli 7558731.666665974 ns/iter 7658546.804347936 ns/iter 0.99
E2E_Compiler_omc 178599615.4999907 ns/iter 170194888.50002062 ns/iter 1.05
E2E_Compiler_omnisharp 6823719.147058793 ns/iter 6952153.90000044 ns/iter 0.98
E2E_Compiler_openapi 25448775.40740934 ns/iter 25852425.444440994 ns/iter 0.98
E2E_Compiler_pre_commit_hooks 5353329.5114507275 ns/iter 5467942.581395449 ns/iter 0.98
E2E_Compiler_pulumi 4087650.6453490797 ns/iter 4154139.810651209 ns/iter 0.98
E2E_Compiler_semantic_release 1576606.5900900352 ns/iter 1609693.8068967157 ns/iter 0.98
E2E_Compiler_stale 1559853.3266218558 ns/iter 1600570.4965675261 ns/iter 0.97
E2E_Compiler_stylecop 6253062.61261292 ns/iter 6279085.142857355 ns/iter 1.00
E2E_Compiler_tmuxinator 1930930.972375552 ns/iter 1989311.3210226365 ns/iter 0.97
E2E_Compiler_ui5 50010031.28571873 ns/iter 50378557.899989575 ns/iter 0.99
E2E_Compiler_ui5_manifest 341515188.5000114 ns/iter 331826413.99997693 ns/iter 1.03
E2E_Compiler_unreal_engine_uproject 4660045.620000043 ns/iter 4834766.270270442 ns/iter 0.96
E2E_Compiler_users_array 762121.110262057 ns/iter 810889.3189252409 ns/iter 0.94
E2E_Compiler_vercel 12513480.107143339 ns/iter 12970955.745454788 ns/iter 0.96
E2E_Compiler_yamllint 338143.43463580497 ns/iter 359838.97850557946 ns/iter 0.94
E2E_Evaluator_adaptivecard 23813.170716640096 ns/iter 26268.899072095785 ns/iter 0.91
E2E_Evaluator_ansible_meta 206814.1368098179 ns/iter 230045.04414206208 ns/iter 0.90
E2E_Evaluator_aws_cdk 42204.21003762702 ns/iter 49617.23543569664 ns/iter 0.85
E2E_Evaluator_babelrc 85096.10551849897 ns/iter 106758.74604131746 ns/iter 0.80
E2E_Evaluator_cerebrum_criminal_case 1002892.0416666714 ns/iter 964503.7468706843 ns/iter 1.04
E2E_Evaluator_clang_format 115478.52813424982 ns/iter 121186.94860297485 ns/iter 0.95
E2E_Evaluator_cmake_presets 5491811.0661153775 ns/iter 4283392.517857281 ns/iter 1.28
E2E_Evaluator_code_climate 154772.919565715 ns/iter 178329.54755191438 ns/iter 0.87
E2E_Evaluator_cql2 180299.59850437567 ns/iter 221529.73390420887 ns/iter 0.81
E2E_Evaluator_cspell 544381.33563756 ns/iter 556047.817675117 ns/iter 0.98
E2E_Evaluator_cypress 165792.5153974605 ns/iter 191289.29168930874 ns/iter 0.87
E2E_Evaluator_deno 247834.77591624684 ns/iter 313135.5087956899 ns/iter 0.79
E2E_Evaluator_dependabot 296444.30660981964 ns/iter 318549.69216922217 ns/iter 0.93
E2E_Evaluator_draft_04 10169732.842856709 ns/iter 8678823.285714814 ns/iter 1.17
E2E_Evaluator_fabric_mod 643966.8373162611 ns/iter 685915.7301740617 ns/iter 0.94
E2E_Evaluator_geojson 19129655.076921947 ns/iter 15893912.068179362 ns/iter 1.20
E2E_Evaluator_gitpod_configuration 197507.5243593376 ns/iter 226770.4640416479 ns/iter 0.87
E2E_Evaluator_helm_chart_lock 240005.98269164763 ns/iter 349893.9613095106 ns/iter 0.69
E2E_Evaluator_importmap 40138.28917387383 ns/iter 47521.75460983168 ns/iter 0.84
E2E_Evaluator_jasmine 104451.35036694176 ns/iter 104285.75204764576 ns/iter 1.00
E2E_Evaluator_jshintrc 1203062.2186978557 ns/iter 1188767.933560447 ns/iter 1.01
E2E_Evaluator_jsconfig 397309.9184136002 ns/iter 420734.78247735294 ns/iter 0.94
E2E_Evaluator_krakend 174870.27736316592 ns/iter 206975.00717702904 ns/iter 0.84
E2E_Evaluator_lazygit 120155.46711781934 ns/iter 150767.892360369 ns/iter 0.80
E2E_Evaluator_lerna 107321.22628976338 ns/iter 137183.46543597142 ns/iter 0.78
E2E_Evaluator_nest_cli 166110.11926606286 ns/iter 180730.1260945772 ns/iter 0.92
E2E_Evaluator_omc 16932.29197364351 ns/iter 18656.557642745403 ns/iter 0.91
E2E_Evaluator_omnisharp 558721.9488818094 ns/iter 620784.6221441518 ns/iter 0.90
E2E_Evaluator_openapi 13570981.884616736 ns/iter 9471039.727272555 ns/iter 1.43
E2E_Evaluator_pre_commit_hooks 457205.5331147537 ns/iter 467233.7406915065 ns/iter 0.98
E2E_Evaluator_pulumi 657411.3956562468 ns/iter 651366.9888991923 ns/iter 1.01
E2E_Evaluator_semantic_release 77103.64683110692 ns/iter 95484.66102157172 ns/iter 0.81
E2E_Evaluator_stale 141926.94461413217 ns/iter 145326.34865262258 ns/iter 0.98
E2E_Evaluator_stylecop 257067.07619396035 ns/iter 278849.71291867306 ns/iter 0.92
E2E_Evaluator_tmuxinator 80187.28723405047 ns/iter 95071.94761128105 ns/iter 0.84
E2E_Evaluator_ui5 460248.1539465735 ns/iter 493535.6728571248 ns/iter 0.93
E2E_Evaluator_ui5_manifest 2442125.8758863574 ns/iter 2479252.427046133 ns/iter 0.99
E2E_Evaluator_unreal_engine_uproject 406880.6276780102 ns/iter 413676.5895117484 ns/iter 0.98
E2E_Evaluator_users_array 540383.6130769307 ns/iter 541951.9251134181 ns/iter 1.00
E2E_Evaluator_vercel 241308.01071554102 ns/iter 300475.153179195 ns/iter 0.80
E2E_Evaluator_yamllint 8084.980380382854 ns/iter 8059.6341741426595 ns/iter 1.00
Micro_Draft4_Meta_1_No_Callback 192.46383406010233 ns/iter 189.8613195601531 ns/iter 1.01
Micro_Draft4_Required_Properties 860.2960040663148 ns/iter 798.7954950719826 ns/iter 1.08
Micro_Draft4_Many_Optional_Properties_Minimal_Match 23.771141883316744 ns/iter 20.921720357314108 ns/iter 1.14
Micro_Draft4_Few_Optional_Properties_Minimal_Match 10.657503821937478 ns/iter 10.896222455118874 ns/iter 0.98
Micro_Draft4_Items_Schema 263.20349467196434 ns/iter 296.3420263400309 ns/iter 0.89
Micro_Draft4_Nested_Object 1.4081653579162554 ns/iter 1.81626001687566 ns/iter 0.78
Micro_Draft4_Properties_Triad_Optional 316.77114231545403 ns/iter 313.26910871429897 ns/iter 1.01
Micro_Draft4_Properties_Triad_Closed 262.0776793502567 ns/iter 258.77774579176156 ns/iter 1.01
Micro_Draft4_Properties_Triad_Required 330.40002290670037 ns/iter 330.2851894958121 ns/iter 1.00
Micro_Draft4_Properties_Closed 59.32076171019119 ns/iter 55.01432047895395 ns/iter 1.08
Micro_Draft4_Non_Recursive_Ref 14.7690313147296 ns/iter 12.471679589609211 ns/iter 1.18
Micro_Draft4_Pattern_Properties_True 145.93262294630003 ns/iter 153.54605360666156 ns/iter 0.95
Micro_Draft4_Ref_To_Single_Property 10.648581020216493 ns/iter 10.899055223451159 ns/iter 0.98
Micro_Draft4_Additional_Properties_Type 30.624774838498073 ns/iter 22.02563833283742 ns/iter 1.39
Micro_Draft4_Nested_Oneof 54.393343230270055 ns/iter 58.125263138995145 ns/iter 0.94
Micro_Draft4_Short_Enum 14.066154310121883 ns/iter 11.904810657699715 ns/iter 1.18
Micro_Draft4_Long_Enum 13.028347182285927 ns/iter 14.023919982839207 ns/iter 0.93
Micro_Draft4_Long_Enum_Short_Strings 14.059927124101069 ns/iter 11.837467928065449 ns/iter 1.19
Micro_Draft4_Type_Object 3.517660141278683 ns/iter 3.427785535573821 ns/iter 1.03
Micro_Draft4_Ref_Single_100 2327583.6966668824 ns/iter 2402662.9006851786 ns/iter 0.97
Micro_Draft4_Compile_Ref_Many_Nested 1708786.9364303914 ns/iter 1746635.7388059634 ns/iter 0.98
Micro_Draft4_Compile_Wrap 2364110.6790538947 ns/iter 2427775.8442906165 ns/iter 0.97
Micro_Draft6_Property_Names 115.20369200407525 ns/iter 119.13052658970854 ns/iter 0.97
Micro_Draft6_Compile_FHIR 19795250565.999935 ns/iter 13976366923 ns/iter 1.42
Micro_Draft7_If_Then_Else 23.70813221688768 ns/iter 23.362121589024266 ns/iter 1.01
Micro_2019_09_Unevaluated_Properties 26.097063246565128 ns/iter 28.37754066893456 ns/iter 0.92
Micro_2019_09_Compile_Wrap 353300492.0000167 ns/iter 304901179.500007 ns/iter 1.16
Micro_2020_12_Dynamic_Ref 224.24665163958707 ns/iter 227.39525947739907 ns/iter 0.99
Micro_2020_12_Dynamic_Ref_Single 3.5223466300610626 ns/iter 3.426018622408489 ns/iter 1.03
Micro_2020_12_Simple_Output_Mask 1018.761687779464 ns/iter 1064.9749588858815 ns/iter 0.96
Micro_2020_12_Simple_Output_Annotations 95273.93010239549 ns/iter 107731.44449619882 ns/iter 0.88
Micro_2020_12_Compile_NonCircular_Shared_Refs 1077093.2832817954 ns/iter 1126539.5925927048 ns/iter 0.96
Micro_2020_12_Exhaustive_Deep_Numeric 8496.217712355035 ns/iter 8299.253259993655 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 168301.33422008064 ns/iter 175561.8428571557 ns/iter 0.96
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 22945.662668913443 ns/iter 22528.48005913303 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 148.9248808406616 ns/iter 141.84513539774514 ns/iter 1.05
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 3995.539088282901 ns/iter 4277.337513634937 ns/iter 0.93
Alterschema_Check_Readibility_ISO_Language_Set_3 382305849.4999714 ns/iter 364877341.50000507 ns/iter 1.05
Alterschema_Check_Readibility_OMC 93942923.71429661 ns/iter 86098465.49998678 ns/iter 1.09
Alterschema_Check_Readibility_KrakenD 1420725652.9999769 ns/iter 1189812890.999974 ns/iter 1.19
Alterschema_Apply_Readibility_KrakenD 133901503437.00009 ns/iter 120229655442.00008 ns/iter 1.11
Alterschema_Check_Invalid_External_Refs 281545217.9999814 ns/iter 302083502.00001633 ns/iter 0.93

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: d6a7781 Previous: cb26a0b Ratio
E2E_Evaluator_adaptivecard 118485 ns 118440 ns 1.00
E2E_Evaluator_ansible-meta 576001 ns 524182 ns 1.10
E2E_Evaluator_aws-cdk 130273 ns 139064 ns 0.94
E2E_Evaluator_babelrc 339944 ns 320371 ns 1.06
E2E_Evaluator_cerebrum-criminal-case 2795930 ns 2540048 ns 1.10
E2E_Evaluator_clang-format 307894 ns 254618 ns 1.21
E2E_Evaluator_cmake-presets 20308146 ns 17353817 ns 1.17
E2E_Evaluator_code-climate 509990 ns 514518 ns 0.99
E2E_Evaluator_cql2 1265478 ns 1252774 ns 1.01
E2E_Evaluator_cspell 1732779 ns 1475415 ns 1.17
E2E_Evaluator_cypress 916728 ns 762346 ns 1.20
E2E_Evaluator_deno 1169514 ns 1045483 ns 1.12
E2E_Evaluator_dependabot 1237990 ns 1161215 ns 1.07
E2E_Evaluator_draft-04 31532552 ns 19758247 ns 1.60
E2E_Evaluator_fabric-mod 2846447 ns 2367581 ns 1.20
E2E_Evaluator_geojson 22271344 ns 24014185 ns 0.93
E2E_Evaluator_gitpod-configuration 788342 ns 707557 ns 1.11
E2E_Evaluator_helm-chart-lock 1008204 ns 1043199 ns 0.97
E2E_Evaluator_importmap 269286 ns 265296 ns 1.02
E2E_Evaluator_jasmine 286184 ns 299329 ns 0.96
E2E_Evaluator_jsconfig 1584687 ns 1214780 ns 1.30
E2E_Evaluator_jshintrc 3113099 ns 2696455 ns 1.15
E2E_Evaluator_krakend 655618 ns 672017 ns 0.98
E2E_Evaluator_lazygit 495956 ns 502460 ns 0.99
E2E_Evaluator_lerna 484149 ns 459600 ns 1.05
E2E_Evaluator_nest-cli 639187 ns 579755 ns 1.10
E2E_Evaluator_omc 92810 ns 93876 ns 0.99
E2E_Evaluator_omnisharp 1580333 ns 1415205 ns 1.12
E2E_Evaluator_openapi 28954838 ns 22259548 ns 1.30
E2E_Evaluator_pre-commit-hooks 2189616 ns 1970753 ns 1.11
E2E_Evaluator_pulumi 2156505 ns 1901319 ns 1.13
E2E_Evaluator_semantic-release 243176 ns 253894 ns 0.96
E2E_Evaluator_stale 395560 ns 408313 ns 0.97
E2E_Evaluator_stylecop 1290975 ns 1253742 ns 1.03
E2E_Evaluator_tmuxinator 222006 ns 223515 ns 0.99
E2E_Evaluator_ui5 2263183 ns 2340103 ns 0.97
E2E_Evaluator_ui5-manifest 12457671 ns 10382025 ns 1.20
E2E_Evaluator_unreal-engine-uproject 1662627 ns 1533620 ns 1.08
E2E_Evaluator_users-array 2499747 ns 2546735 ns 0.98
E2E_Evaluator_vercel 1018441 ns 987858 ns 1.03
E2E_Evaluator_yamllint 24508 ns 25715 ns 0.95

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit bac3ea7 into main May 5, 2026
15 checks passed
@jviotti jviotti deleted the draft3-disallow branch May 5, 2026 17:47
Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: d6a7781 Previous: cb26a0b Ratio
E2E_Compiler_adaptivecard 97805402.66668443 ns/iter 68338322.87499319 ns/iter 1.43
E2E_Compiler_ansible_meta 35700112.500001065 ns/iter 28302267.241381995 ns/iter 1.26
E2E_Compiler_aws_cdk 452718.27290080226 ns/iter 288585.9473023972 ns/iter 1.57
E2E_Compiler_babelrc 3006389.478764592 ns/iter 2270966.2961783665 ns/iter 1.32
E2E_Compiler_clang_format 25017668.178577423 ns/iter 15352899.312498873 ns/iter 1.63
E2E_Compiler_cmake_presets 41108083.33333201 ns/iter 26597418.222220566 ns/iter 1.55
E2E_Compiler_code_climate 3479527.217742147 ns/iter 2414040.416666694 ns/iter 1.44
E2E_Compiler_cql2 23027947.3235321 ns/iter 12135017.081967086 ns/iter 1.90
E2E_Compiler_cspell 34437535.05263502 ns/iter 20343311.361108996 ns/iter 1.69
E2E_Compiler_cypress 5968014.563105825 ns/iter 3720426.0947365393 ns/iter 1.60
E2E_Compiler_deno 12069350.746267093 ns/iter 6705532.243477532 ns/iter 1.80
E2E_Compiler_dependabot 5685851.0472448245 ns/iter 3630898.8112244946 ns/iter 1.57
E2E_Compiler_draft_04 3142771.247524089 ns/iter 2015816.3623594656 ns/iter 1.56
E2E_Compiler_fabric_mod 5619257.079999898 ns/iter 4424200.897297801 ns/iter 1.27
E2E_Compiler_geojson 35433897.72726807 ns/iter 27579483.870967593 ns/iter 1.28
E2E_Compiler_gitpod_configuration 6239145.642201522 ns/iter 4236533.885542015 ns/iter 1.47
E2E_Compiler_helm_chart_lock 763847.291718146 ns/iter 553397.6126657086 ns/iter 1.38
E2E_Compiler_importmap 257416.42489623875 ns/iter 221890.9731199892 ns/iter 1.16
E2E_Compiler_jasmine 1496175.1930233603 ns/iter 1094055.9787234296 ns/iter 1.37
E2E_Compiler_jshintrc 5419874.44736797 ns/iter 3326332.754629338 ns/iter 1.63
E2E_Compiler_jsconfig 30035126.826078344 ns/iter 19096423.076922663 ns/iter 1.57
E2E_Compiler_krakend 205830972.33331195 ns/iter 149568323.00001112 ns/iter 1.38
E2E_Compiler_lazygit 48605642.85715035 ns/iter 35255825.00000155 ns/iter 1.38
E2E_Compiler_lerna 1965229.2321981925 ns/iter 1394931.2144213626 ns/iter 1.41
E2E_Compiler_nest_cli 9790482.674157174 ns/iter 6387090.2719294885 ns/iter 1.53
E2E_Compiler_omc 265678596.99995705 ns/iter 194698614.49999827 ns/iter 1.36
E2E_Compiler_omnisharp 8868427.77333489 ns/iter 6492957.589285554 ns/iter 1.37
E2E_Compiler_openapi 34119373.09090263 ns/iter 23192902.787879135 ns/iter 1.47
E2E_Compiler_pre_commit_hooks 6028622.983871129 ns/iter 4640532.379518532 ns/iter 1.30
E2E_Compiler_pulumi 3999174.941177042 ns/iter 3703470.849765469 ns/iter 1.08
E2E_Compiler_semantic_release 1735017.231308609 ns/iter 1271875.0000000729 ns/iter 1.36
E2E_Compiler_stale 2052285.7142859483 ns/iter 1284318.195501715 ns/iter 1.60
E2E_Compiler_stylecop 9462211.000001075 ns/iter 5635343.29710101 ns/iter 1.68
E2E_Compiler_tmuxinator 2324825.216911777 ns/iter 1569380.1556886581 ns/iter 1.48
E2E_Compiler_ui5 80737516.59999289 ns/iter 56185477.53846752 ns/iter 1.44
E2E_Compiler_ui5_manifest 526146082.9999578 ns/iter 318071874.9999869 ns/iter 1.65
E2E_Compiler_unreal_engine_uproject 5759041.669291294 ns/iter 3900681.081080546 ns/iter 1.48
E2E_Compiler_users_array 1301665.025590682 ns/iter 768491.0330330343 ns/iter 1.69
E2E_Compiler_vercel 18729090.064513706 ns/iter 11979279.564515779 ns/iter 1.56
E2E_Compiler_yamllint 415287.3101550691 ns/iter 288810.898672286 ns/iter 1.44
E2E_Evaluator_adaptivecard 24542.419827162506 ns/iter 18239.031933132974 ns/iter 1.35
E2E_Evaluator_ansible_meta 232149.03967170088 ns/iter 163883.52854217833 ns/iter 1.42
E2E_Evaluator_aws_cdk 53581.97499999733 ns/iter 34004.096944853954 ns/iter 1.58
E2E_Evaluator_babelrc 117049.68967847973 ns/iter 75982.84163081148 ns/iter 1.54
E2E_Evaluator_cerebrum_criminal_case 1071840.511204597 ns/iter 621676.7842494075 ns/iter 1.72
E2E_Evaluator_clang_format 138614.28571430588 ns/iter 103202.02403987505 ns/iter 1.34
E2E_Evaluator_cmake_presets 4910182.086614727 ns/iter 3495812.701923084 ns/iter 1.40
E2E_Evaluator_code_climate 205532.82967032396 ns/iter 126968.84929844261 ns/iter 1.62
E2E_Evaluator_cql2 242695.39930554313 ns/iter 144901.01367147133 ns/iter 1.67
E2E_Evaluator_cspell 600291.368839505 ns/iter 398099.7631734789 ns/iter 1.51
E2E_Evaluator_cypress 202773.1237081477 ns/iter 148747.9969573837 ns/iter 1.36
E2E_Evaluator_deno 334925.9103976971 ns/iter 216883.65697674226 ns/iter 1.54
E2E_Evaluator_dependabot 354581.4423939516 ns/iter 232245.45527672253 ns/iter 1.53
E2E_Evaluator_draft_04 7962297.673077937 ns/iter 5445627.080000577 ns/iter 1.46
E2E_Evaluator_fabric_mod 705720.5508884714 ns/iter 476395.40642075054 ns/iter 1.48
E2E_Evaluator_geojson 15952665.589746827 ns/iter 11003791.661538834 ns/iter 1.45
E2E_Evaluator_gitpod_configuration 227104.9612205852 ns/iter 169925.79300763638 ns/iter 1.34
E2E_Evaluator_helm_chart_lock 317414.4313984906 ns/iter 211147.8513315693 ns/iter 1.50
E2E_Evaluator_importmap 43052.32041499899 ns/iter 34026.85523237919 ns/iter 1.27
E2E_Evaluator_jasmine 110828.85216176927 ns/iter 85182.83197631271 ns/iter 1.30
E2E_Evaluator_jshintrc 1332515.810276947 ns/iter 945651.5306122246 ns/iter 1.41
E2E_Evaluator_jsconfig 484803.4733124317 ns/iter 295662.1706792726 ns/iter 1.64
E2E_Evaluator_krakend 231828.64595287602 ns/iter 131233.0060273909 ns/iter 1.77
E2E_Evaluator_lazygit 158185.08399109248 ns/iter 96669.59032861129 ns/iter 1.64
E2E_Evaluator_lerna 179295.52687638171 ns/iter 109621.89816916114 ns/iter 1.64
E2E_Evaluator_nest_cli 207226.25764569294 ns/iter 121657.40746171426 ns/iter 1.70
E2E_Evaluator_omc 21019.58216435897 ns/iter 13101.931545846546 ns/iter 1.60
E2E_Evaluator_omnisharp 667946.3292469364 ns/iter 415641.4711191456 ns/iter 1.61
E2E_Evaluator_openapi 9497708.954544386 ns/iter 5855006.1874997895 ns/iter 1.62
E2E_Evaluator_pre_commit_hooks 546625.58300015 ns/iter 325460.3647444891 ns/iter 1.68
E2E_Evaluator_pulumi 764103.7416934812 ns/iter 501852.8645833619 ns/iter 1.52
E2E_Evaluator_semantic_release 99794.80451128876 ns/iter 68550.12449373797 ns/iter 1.46
E2E_Evaluator_stale 152363.7435172456 ns/iter 106982.41138945463 ns/iter 1.42
E2E_Evaluator_stylecop 271093.0767894692 ns/iter 176974.83584759608 ns/iter 1.53
E2E_Evaluator_tmuxinator 112309.1987620211 ns/iter 73744.73258828286 ns/iter 1.52
E2E_Evaluator_ui5 547058.7305070922 ns/iter 386332.2411820757 ns/iter 1.42
E2E_Evaluator_ui5_manifest 2510452.577405764 ns/iter 1655928.4934497478 ns/iter 1.52
E2E_Evaluator_unreal_engine_uproject 474105.3118279172 ns/iter 326740.8845286195 ns/iter 1.45
E2E_Evaluator_users_array 608115.9440388465 ns/iter 460077.2760844515 ns/iter 1.32
E2E_Evaluator_vercel 342448.727775377 ns/iter 228468.31079402452 ns/iter 1.50
E2E_Evaluator_yamllint 8141.162417636038 ns/iter 5813.890415769198 ns/iter 1.40
Micro_Draft4_Meta_1_No_Callback 202.37165277271174 ns/iter 134.815993749686 ns/iter 1.50
Micro_Draft4_Required_Properties 946.0546999567757 ns/iter 641.7540907062495 ns/iter 1.47
Micro_Draft4_Many_Optional_Properties_Minimal_Match 23.451752129432872 ns/iter 15.341454763145347 ns/iter 1.53
Micro_Draft4_Few_Optional_Properties_Minimal_Match 9.703788352343635 ns/iter 7.193445776471353 ns/iter 1.35
Micro_Draft4_Items_Schema 333.67040843576945 ns/iter 266.2250735666611 ns/iter 1.25
Micro_Draft4_Nested_Object 0.8851200272527922 ns/iter 0.7358298507603662 ns/iter 1.20
Micro_Draft4_Properties_Triad_Optional 312.4424421858979 ns/iter 235.64341279175997 ns/iter 1.33
Micro_Draft4_Properties_Triad_Closed 247.29765104294776 ns/iter 178.233341854501 ns/iter 1.39
Micro_Draft4_Properties_Triad_Required 301.1721906157747 ns/iter 222.1040344804673 ns/iter 1.36
Micro_Draft4_Properties_Closed 49.19283535023946 ns/iter 40.61111656776903 ns/iter 1.21
Micro_Draft4_Non_Recursive_Ref 15.512919247049028 ns/iter 16.34263960393837 ns/iter 0.95
Micro_Draft4_Pattern_Properties_True 183.77632256914833 ns/iter 149.33423752177737 ns/iter 1.23
Micro_Draft4_Ref_To_Single_Property 9.406189075405873 ns/iter 7.161429226481343 ns/iter 1.31
Micro_Draft4_Additional_Properties_Type 31.48331136468686 ns/iter 25.297935888875163 ns/iter 1.24
Micro_Draft4_Nested_Oneof 67.96032496373039 ns/iter 40.102683087589334 ns/iter 1.69
Micro_Draft4_Short_Enum 6.73278490268095 ns/iter 4.749713477625283 ns/iter 1.42
Micro_Draft4_Long_Enum 13.14213176230178 ns/iter 9.78097370642221 ns/iter 1.34
Micro_Draft4_Long_Enum_Short_Strings 7.329238455974219 ns/iter 6.160311932198394 ns/iter 1.19
Micro_Draft4_Type_Object 2.7729840584514998 ns/iter 2.1894469252181996 ns/iter 1.27
Micro_Draft4_Ref_Single_100 2522224.569852771 ns/iter 1750885.4430380329 ns/iter 1.44
Micro_Draft4_Compile_Ref_Many_Nested 1732993.4145079746 ns/iter 1311433.8710802842 ns/iter 1.32
Micro_Draft4_Compile_Wrap 2903165.76724214 ns/iter 2017807.755043344 ns/iter 1.44
Micro_Draft6_Property_Names 148.07524101516725 ns/iter 94.06306707694289 ns/iter 1.57
Micro_Draft6_Compile_FHIR 21609029834.00001 ns/iter 9212910041.999975 ns/iter 2.35
Micro_Draft7_If_Then_Else 24.72362057692566 ns/iter 17.25613966657504 ns/iter 1.43
Micro_2019_09_Unevaluated_Properties 41.22028775763773 ns/iter 27.182707414557804 ns/iter 1.52
Micro_2019_09_Compile_Wrap 451272749.9999301 ns/iter 298485979.00002 ns/iter 1.51
Micro_2020_12_Dynamic_Ref 303.67265400895616 ns/iter 186.18281916695832 ns/iter 1.63
Micro_2020_12_Dynamic_Ref_Single 3.176672583575162 ns/iter 2.1889231304922787 ns/iter 1.45
Micro_2020_12_Simple_Output_Mask 1201.7655586713397 ns/iter 792.4440109594273 ns/iter 1.52
Micro_2020_12_Simple_Output_Annotations 123321.66672642554 ns/iter 85856.35799901623 ns/iter 1.44
Micro_2020_12_Compile_NonCircular_Shared_Refs 1479432.1503132342 ns/iter 818545.9123223815 ns/iter 1.81
Micro_2020_12_Exhaustive_Deep_Numeric 7558.981298775059 ns/iter 5410.988029437842 ns/iter 1.40
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 180107.55427926517 ns/iter 118656.28189857863 ns/iter 1.52
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 27689.831403907512 ns/iter 14592.240910501054 ns/iter 1.90
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 141.45844555505604 ns/iter 94.91806318391063 ns/iter 1.49
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 7258.404756089486 ns/iter 4911.249429825773 ns/iter 1.48
Alterschema_Check_Readibility_ISO_Language_Set_3 368295312.50009495 ns/iter 237501722.33333918 ns/iter 1.55
Alterschema_Check_Readibility_OMC 100685724.00001585 ns/iter 59472736.16666848 ns/iter 1.69
Alterschema_Check_Readibility_KrakenD 1699988249.999933 ns/iter 653616166.0000062 ns/iter 2.60
Alterschema_Apply_Readibility_KrakenD 92271783542.00009 ns/iter 62071039500.00021 ns/iter 1.49
Alterschema_Check_Invalid_External_Refs 236410736.00000104 ns/iter 161925593.75002703 ns/iter 1.46

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: d6a7781 Previous: cb26a0b Ratio
E2E_Evaluator_adaptivecard 161037 ns 92693 ns 1.74
E2E_Evaluator_ansible-meta 546164 ns 340147 ns 1.61
E2E_Evaluator_aws-cdk 165097 ns 108316 ns 1.52
E2E_Evaluator_babelrc 457544 ns 255210 ns 1.79
E2E_Evaluator_cerebrum-criminal-case 2637265 ns 1545265 ns 1.71
E2E_Evaluator_clang-format 299901 ns 167456 ns 1.79
E2E_Evaluator_cmake-presets 22946236 ns 12176198 ns 1.88
E2E_Evaluator_code-climate 609888 ns 393244 ns 1.55
E2E_Evaluator_cql2 1814275 ns 1000409 ns 1.81
E2E_Evaluator_cspell 3012784 ns 1207506 ns 2.50
E2E_Evaluator_cypress 1312376 ns 550704 ns 2.38
E2E_Evaluator_deno 2096641 ns 715271 ns 2.93
E2E_Evaluator_dependabot 2351535 ns 724831 ns 3.24
E2E_Evaluator_draft-04 31186972 ns 14926706 ns 2.09
E2E_Evaluator_fabric-mod 3333862 ns 1295769 ns 2.57
E2E_Evaluator_geojson 21759331 ns 14027392 ns 1.55
E2E_Evaluator_gitpod-configuration 852166 ns 453982 ns 1.88
E2E_Evaluator_helm-chart-lock 982065 ns 795569 ns 1.23
E2E_Evaluator_importmap 304920 ns 196200 ns 1.55
E2E_Evaluator_jasmine 311577 ns 198751 ns 1.57
E2E_Evaluator_jsconfig 1108326 ns 896026 ns 1.24
E2E_Evaluator_jshintrc 2988483 ns 2128333 ns 1.40
E2E_Evaluator_krakend 492453 ns 402885 ns 1.22
E2E_Evaluator_lazygit 406599 ns 253670 ns 1.60
E2E_Evaluator_lerna 387610 ns 294167 ns 1.32
E2E_Evaluator_nest-cli 590221 ns 411879 ns 1.43
E2E_Evaluator_omc 92723 ns 68974 ns 1.34
E2E_Evaluator_omnisharp 1538573 ns 965711 ns 1.59
E2E_Evaluator_openapi 24286087 ns 15351117 ns 1.58
E2E_Evaluator_pre-commit-hooks 2296733 ns 1304577 ns 1.76
E2E_Evaluator_pulumi 2094059 ns 1360069 ns 1.54
E2E_Evaluator_semantic-release 235522 ns 179026 ns 1.32
E2E_Evaluator_stale 393689 ns 278375 ns 1.41
E2E_Evaluator_stylecop 1282600 ns 699811 ns 1.83
E2E_Evaluator_tmuxinator 223092 ns 157685 ns 1.41
E2E_Evaluator_ui5 2090152 ns 1487892 ns 1.40
E2E_Evaluator_ui5-manifest 11691849 ns 9459540 ns 1.24
E2E_Evaluator_unreal-engine-uproject 1371993 ns 1147625 ns 1.20
E2E_Evaluator_users-array 2614799 ns 1835737 ns 1.42
E2E_Evaluator_vercel 1163770 ns 756498 ns 1.54
E2E_Evaluator_yamllint 28328 ns 22913 ns 1.24

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: d6a7781 Previous: cb26a0b Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 387890178.50001526 ns/iter 375173863.99997574 ns/iter 1.03
Alterschema_Check_Readibility_OMC 107017569.7142791 ns/iter 98633907.85715507 ns/iter 1.08
Alterschema_Check_Readibility_KrakenD 1550495110.9999182 ns/iter 1342730494.0000794 ns/iter 1.15
Alterschema_Apply_Readibility_KrakenD 141212464276.99997 ns/iter 139466719425.00006 ns/iter 1.01
Alterschema_Check_Invalid_External_Refs 312958934.9999833 ns/iter 353032600.0000059 ns/iter 0.89
Micro_2020_12_Dynamic_Ref 258.62666286733264 ns/iter 261.2685304537304 ns/iter 0.99
Micro_2020_12_Dynamic_Ref_Single 4.219694605311794 ns/iter 4.735270287916898 ns/iter 0.89
Micro_2020_12_Simple_Output_Mask 1128.6259357817212 ns/iter 1181.0105226277067 ns/iter 0.96
Micro_2020_12_Simple_Output_Annotations 106998.11355081311 ns/iter 116693.26428088556 ns/iter 0.92
Micro_2020_12_Compile_NonCircular_Shared_Refs 1192260.0374786814 ns/iter 1268416.0943059376 ns/iter 0.94
Micro_2020_12_Exhaustive_Deep_Numeric 7822.356307658098 ns/iter 8421.922105713425 ns/iter 0.93
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 168026.2770624923 ns/iter 168499.5633198029 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 26087.420443952 ns/iter 26711.42844533807 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 134.58003225571125 ns/iter 141.5110305557251 ns/iter 0.95
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4628.771602834832 ns/iter 4956.247622774227 ns/iter 0.93
Micro_2019_09_Unevaluated_Properties 28.61203808821513 ns/iter 28.96499412758599 ns/iter 0.99
Micro_2019_09_Compile_Wrap 344483054.4999604 ns/iter 333878503.50004554 ns/iter 1.03
Micro_Draft7_If_Then_Else 25.113936625370513 ns/iter 25.59448585799214 ns/iter 0.98
Micro_Draft6_Property_Names 144.03152913749136 ns/iter 151.8272721627398 ns/iter 0.95
Micro_Draft6_Compile_FHIR 16812854486.000105 ns/iter 14735110960.999918 ns/iter 1.14
Micro_Draft4_Meta_1_No_Callback 174.10722625029155 ns/iter 165.7389021883355 ns/iter 1.05
Micro_Draft4_Required_Properties 808.4596223148235 ns/iter 853.2061766837093 ns/iter 0.95
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.134246771336514 ns/iter 20.28251798112198 ns/iter 1.04
Micro_Draft4_Few_Optional_Properties_Minimal_Match 13.021323019984312 ns/iter 13.103601881495162 ns/iter 0.99
Micro_Draft4_Items_Schema 316.5530418187231 ns/iter 347.92122121157695 ns/iter 0.91
Micro_Draft4_Nested_Object 1.7582481391198213 ns/iter 1.8691215251902438 ns/iter 0.94
Micro_Draft4_Properties_Triad_Optional 454.3023584733368 ns/iter 438.977922911653 ns/iter 1.03
Micro_Draft4_Properties_Triad_Closed 385.7222964116763 ns/iter 319.7564663776535 ns/iter 1.21
Micro_Draft4_Properties_Triad_Required 422.2392074447702 ns/iter 403.5879116942409 ns/iter 1.05
Micro_Draft4_Properties_Closed 62.372190484997084 ns/iter 62.130974918483304 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 8.828759245348108 ns/iter 9.655682204094907 ns/iter 0.91
Micro_Draft4_Pattern_Properties_True 187.54173746531887 ns/iter 218.20220103757126 ns/iter 0.86
Micro_Draft4_Ref_To_Single_Property 12.659302836604944 ns/iter 13.093527958004998 ns/iter 0.97
Micro_Draft4_Additional_Properties_Type 14.86351172546588 ns/iter 15.572105793378062 ns/iter 0.95
Micro_Draft4_Nested_Oneof 65.45263225950559 ns/iter 65.67046121057092 ns/iter 1.00
Micro_Draft4_Short_Enum 14.775151319297274 ns/iter 14.726598508581644 ns/iter 1.00
Micro_Draft4_Long_Enum 14.777255193674517 ns/iter 14.04796746149048 ns/iter 1.05
Micro_Draft4_Long_Enum_Short_Strings 14.76462584370994 ns/iter 14.692437842946923 ns/iter 1.00
Micro_Draft4_Type_Object 4.221312871997217 ns/iter 4.688136462288865 ns/iter 0.90
Micro_Draft4_Ref_Single_100 2537067.625898541 ns/iter 2519544.0251796725 ns/iter 1.01
Micro_Draft4_Compile_Ref_Many_Nested 1849295.955026411 ns/iter 1831754.9999995464 ns/iter 1.01
Micro_Draft4_Compile_Wrap 2590746.2177117625 ns/iter 2586053.6518520247 ns/iter 1.00
E2E_Compiler_adaptivecard 73097535.20000868 ns/iter 68980715.2000185 ns/iter 1.06
E2E_Compiler_ansible_meta 31333487.454544827 ns/iter 30748036.608696092 ns/iter 1.02
E2E_Compiler_aws_cdk 403575.7083812313 ns/iter 424290.9793438484 ns/iter 0.95
E2E_Compiler_babelrc 2799699.660000442 ns/iter 2792753.1999994246 ns/iter 1.00
E2E_Compiler_clang_format 20047009.571427613 ns/iter 19870976.48571502 ns/iter 1.01
E2E_Compiler_cmake_presets 28590509.239993483 ns/iter 27809828.919998836 ns/iter 1.03
E2E_Compiler_code_climate 2839526.2032514377 ns/iter 2817376.5081302873 ns/iter 1.01
E2E_Compiler_cql2 14437301.208332086 ns/iter 14317158.346937839 ns/iter 1.01
E2E_Compiler_cspell 24776196.285716064 ns/iter 24330470.67857582 ns/iter 1.02
E2E_Compiler_cypress 4259286.987803535 ns/iter 4143100.425149449 ns/iter 1.03
E2E_Compiler_deno 8332478.940474175 ns/iter 8296461.941175521 ns/iter 1.00
E2E_Compiler_dependabot 4266411.408536896 ns/iter 4245937.084847769 ns/iter 1.00
E2E_Compiler_draft_04 2939015.6638651243 ns/iter 2969730.0472107134 ns/iter 0.99
E2E_Compiler_fabric_mod 5232935.721804274 ns/iter 5211041.02238754 ns/iter 1.00
E2E_Compiler_geojson 24794573.35713927 ns/iter 24401276.344829526 ns/iter 1.02
E2E_Compiler_gitpod_configuration 5368697.007633141 ns/iter 5338569.6287874095 ns/iter 1.01
E2E_Compiler_helm_chart_lock 752663.8029352268 ns/iter 764780.8904710677 ns/iter 0.98
E2E_Compiler_importmap 297790.9187925658 ns/iter 315925.4364791295 ns/iter 0.94
E2E_Compiler_jasmine 1460235.5176711117 ns/iter 1496667.522198442 ns/iter 0.98
E2E_Compiler_jshintrc 4666969.228188257 ns/iter 4739250.328767624 ns/iter 0.98
E2E_Compiler_jsconfig 23880392.13333286 ns/iter 23550160.533333536 ns/iter 1.01
E2E_Compiler_krakend 151170234.19998077 ns/iter 153033628.39999864 ns/iter 0.99
E2E_Compiler_lazygit 38375544.526316896 ns/iter 36455529.89473799 ns/iter 1.05
E2E_Compiler_lerna 1728231.1086417416 ns/iter 1768592.2817260372 ns/iter 0.98
E2E_Compiler_nest_cli 8097883.977009995 ns/iter 8127941.850575397 ns/iter 1.00
E2E_Compiler_omc 179602019.50000966 ns/iter 172213756.25001657 ns/iter 1.04
E2E_Compiler_omnisharp 7284413.760416442 ns/iter 7262846.87628969 ns/iter 1.00
E2E_Compiler_openapi 27750325.360002536 ns/iter 27164383.769226894 ns/iter 1.02
E2E_Compiler_pre_commit_hooks 5765201.3500008555 ns/iter 5723370.655737497 ns/iter 1.01
E2E_Compiler_pulumi 4392738.176100283 ns/iter 4400617.487341393 ns/iter 1.00
E2E_Compiler_semantic_release 1713128.144254365 ns/iter 1711716.842364493 ns/iter 1.00
E2E_Compiler_stale 1663277.3007160923 ns/iter 1685079.3100961535 ns/iter 0.99
E2E_Compiler_stylecop 6379580.672726413 ns/iter 6363704.900001142 ns/iter 1.00
E2E_Compiler_tmuxinator 2112625.6066066627 ns/iter 2129596.419453096 ns/iter 0.99
E2E_Compiler_ui5 52818332.30768685 ns/iter 51019135.2999982 ns/iter 1.04
E2E_Compiler_ui5_manifest 347016240.0000163 ns/iter 339173661.5000127 ns/iter 1.02
E2E_Compiler_unreal_engine_uproject 4950186.598590898 ns/iter 4969799.6737595145 ns/iter 1.00
E2E_Compiler_users_array 862965.8181817525 ns/iter 884841.7726129806 ns/iter 0.98
E2E_Compiler_vercel 13428076.788460867 ns/iter 13260568.943395518 ns/iter 1.01
E2E_Compiler_yamllint 362758.1097308152 ns/iter 381827.9334787573 ns/iter 0.95
E2E_Evaluator_adaptivecard 23217.685924365604 ns/iter 23326.942899999874 ns/iter 1.00
E2E_Evaluator_ansible_meta 223754.67611466305 ns/iter 246068.7811068584 ns/iter 0.91
E2E_Evaluator_aws_cdk 45396.979880779756 ns/iter 52329.445464806115 ns/iter 0.87
E2E_Evaluator_babelrc 83950.02379796411 ns/iter 106113.32986366855 ns/iter 0.79
E2E_Evaluator_cerebrum_criminal_case 1073598.2176655729 ns/iter 1030618.4823009134 ns/iter 1.04
E2E_Evaluator_clang_format 92853.91225437172 ns/iter 102666.65384049618 ns/iter 0.90
E2E_Evaluator_cmake_presets 6088055.901784628 ns/iter 4785465.797201961 ns/iter 1.27
E2E_Evaluator_code_climate 166654.35808580625 ns/iter 193422.02514287367 ns/iter 0.86
E2E_Evaluator_cql2 200767.77911648832 ns/iter 217947.91875196257 ns/iter 0.92
E2E_Evaluator_cspell 507927.7428361203 ns/iter 537852.6656416794 ns/iter 0.94
E2E_Evaluator_cypress 134490.755818439 ns/iter 175171.17781118993 ns/iter 0.77
E2E_Evaluator_deno 296694.92524083727 ns/iter 343015.4552491678 ns/iter 0.86
E2E_Evaluator_dependabot 333976.52192565094 ns/iter 366329.16373958247 ns/iter 0.91
E2E_Evaluator_draft_04 8639617.775000375 ns/iter 8019866.393259067 ns/iter 1.08
E2E_Evaluator_fabric_mod 709621.7817258645 ns/iter 757803.9183895998 ns/iter 0.94
E2E_Evaluator_geojson 18087475.121951796 ns/iter 15846572.844444988 ns/iter 1.14
E2E_Evaluator_gitpod_configuration 219737.1789407613 ns/iter 253518.53280460864 ns/iter 0.87
E2E_Evaluator_helm_chart_lock 206820.5352993447 ns/iter 310014.58908935264 ns/iter 0.67
E2E_Evaluator_importmap 40029.32740767215 ns/iter 48834.7001522072 ns/iter 0.82
E2E_Evaluator_jasmine 100908.57682875039 ns/iter 119061.68832714284 ns/iter 0.85
E2E_Evaluator_jshintrc 985381.2112678369 ns/iter 1048281.753048949 ns/iter 0.94
E2E_Evaluator_jsconfig 361906.73460943135 ns/iter 399496.9309360905 ns/iter 0.91
E2E_Evaluator_krakend 179014.06925061598 ns/iter 207115.34758871936 ns/iter 0.86
E2E_Evaluator_lazygit 121050.24804990934 ns/iter 131587.8527571683 ns/iter 0.92
E2E_Evaluator_lerna 133351.93937646944 ns/iter 149942.59319148617 ns/iter 0.89
E2E_Evaluator_nest_cli 177605.56491679273 ns/iter 194125.48737649503 ns/iter 0.91
E2E_Evaluator_omc 18474.538746257134 ns/iter 18755.80513282713 ns/iter 0.99
E2E_Evaluator_omnisharp 504292.0881923577 ns/iter 548974.3840063169 ns/iter 0.92
E2E_Evaluator_openapi 12111770.896549858 ns/iter 11121089.00000308 ns/iter 1.09
E2E_Evaluator_pre_commit_hooks 466803.23673738417 ns/iter 516183.3757623027 ns/iter 0.90
E2E_Evaluator_pulumi 703310.3775719379 ns/iter 733587.5519411246 ns/iter 0.96
E2E_Evaluator_semantic_release 85178.19189451936 ns/iter 104294.11907963184 ns/iter 0.82
E2E_Evaluator_stale 146302.27483791846 ns/iter 153918.73801706452 ns/iter 0.95
E2E_Evaluator_stylecop 282312.003658473 ns/iter 310262.42434638215 ns/iter 0.91
E2E_Evaluator_tmuxinator 86355.83823348008 ns/iter 106396.69349570115 ns/iter 0.81
E2E_Evaluator_ui5 497390.8855932076 ns/iter 540890.057857775 ns/iter 0.92
E2E_Evaluator_ui5_manifest 2715874.629343822 ns/iter 2878878.4538152823 ns/iter 0.94
E2E_Evaluator_unreal_engine_uproject 434608.5926387883 ns/iter 471764.96598626877 ns/iter 0.92
E2E_Evaluator_users_array 640095.7318436747 ns/iter 611344.7393200431 ns/iter 1.05
E2E_Evaluator_vercel 252860.4865759774 ns/iter 306605.1312554585 ns/iter 0.82
E2E_Evaluator_yamllint 9236.807659485657 ns/iter 11373.793291803602 ns/iter 0.81

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: d6a7781 Previous: cb26a0b Ratio
E2E_Evaluator_adaptivecard 117666 ns 118697 ns 0.99
E2E_Evaluator_ansible-meta 551550 ns 528563 ns 1.04
E2E_Evaluator_aws-cdk 133395 ns 140350 ns 0.95
E2E_Evaluator_babelrc 314096 ns 328323 ns 0.96
E2E_Evaluator_cerebrum-criminal-case 2778890 ns 2502607 ns 1.11
E2E_Evaluator_clang-format 259645 ns 269471 ns 0.96
E2E_Evaluator_cmake-presets 19314583 ns 19917635 ns 0.97
E2E_Evaluator_code-climate 495710 ns 510475 ns 0.97
E2E_Evaluator_cql2 1266121 ns 1239219 ns 1.02
E2E_Evaluator_cspell 1643804 ns 1495523 ns 1.10
E2E_Evaluator_cypress 869406 ns 779344 ns 1.12
E2E_Evaluator_deno 1164371 ns 1105282 ns 1.05
E2E_Evaluator_dependabot 1287091 ns 1118333 ns 1.15
E2E_Evaluator_draft-04 29308815 ns 27563693 ns 1.06
E2E_Evaluator_fabric-mod 2542398 ns 2377986 ns 1.07
E2E_Evaluator_geojson 20378617 ns 20786684 ns 0.98
E2E_Evaluator_gitpod-configuration 733368 ns 722667 ns 1.01
E2E_Evaluator_helm-chart-lock 1056831 ns 1006837 ns 1.05
E2E_Evaluator_importmap 266713 ns 267025 ns 1.00
E2E_Evaluator_jasmine 281222 ns 308211 ns 0.91
E2E_Evaluator_jsconfig 1460802 ns 1250200 ns 1.17
E2E_Evaluator_jshintrc 2916180 ns 2820384 ns 1.03
E2E_Evaluator_krakend 632691 ns 673183 ns 0.94
E2E_Evaluator_lazygit 470502 ns 504998 ns 0.93
E2E_Evaluator_lerna 539541 ns 474197 ns 1.14
E2E_Evaluator_nest-cli 613241 ns 595732 ns 1.03
E2E_Evaluator_omc 90707 ns 92369 ns 0.98
E2E_Evaluator_omnisharp 1490398 ns 1399209 ns 1.07
E2E_Evaluator_openapi 26931255 ns 26660575 ns 1.01
E2E_Evaluator_pre-commit-hooks 2131416 ns 2056098 ns 1.04
E2E_Evaluator_pulumi 2036561 ns 1904403 ns 1.07
E2E_Evaluator_semantic-release 225539 ns 253622 ns 0.89
E2E_Evaluator_stale 381441 ns 391218 ns 0.98
E2E_Evaluator_stylecop 1268635 ns 1262636 ns 1.00
E2E_Evaluator_tmuxinator 216566 ns 228285 ns 0.95
E2E_Evaluator_ui5 2303505 ns 2354461 ns 0.98
E2E_Evaluator_ui5-manifest 11314000 ns 11955078 ns 0.95
E2E_Evaluator_unreal-engine-uproject 1590870 ns 1509153 ns 1.05
E2E_Evaluator_users-array 2466154 ns 2453246 ns 1.01
E2E_Evaluator_vercel 987387 ns 992247 ns 1.00
E2E_Evaluator_yamllint 24493 ns 26083 ns 0.94

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant